Modelling the brain as an Apollonian network 
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Networks of living neurons exhibit an avalanche mode of activity, experimentally found in organ- 
otypic cultures. Moreover, experimental studies of morphology indicates that neurons develop a 
network of small- world-like connections, with the possibility of very high connectivity degree. Here 
we study a recent model based on self-organized criticality, which consists in an electrical network 
with threshold firing and activity-dependent synapse strengths. We study the model on a scale-free 
network, the Apollonian network, which presents many features of neuronal systems. The system 
exhibits a power law distributed avalanche activity. The analysis of the power spectra of the electri- 
cal signal reproduces very robustly the power law behaviour with the exponent 0.8, experimentally 
measured in electroencephalograms (EEG) spectra. The exponents are found quite stable with re- 
spect to initial configurations and strength of plastic remodelling, indicating that universality holds 
for a wide class of brain models. 

PACS numbers: 87.19.La, 05.65. +b, 05.45.Tp, 89.75.-k 



I. INTRODUCTION 



Neuronal networks exhibit diverse patters of activity, 
including oscillations, synchronization and waves. Dur- 
ing neuronal activity, each neuron can receive inputs 
by thousands of other neurons and, when it reaches 
a threshold, redistributes this integrated activity back 
to the neuronal network. Recently a neuronal activity 
based on avalanches has been observed in organotypic 
cultures from coronal slices of rat cortex [l[ where neu- 
ronal avalanches are stable for many hours 0]. More 
precisely, recording spontaneous local potentials contin- 
uously by a multielectrode array, has shown that activ- 
ity initiated at one electrode might spread to other elec- 
trodes not necessarily contiguous, as in a wave-like prop- 
agation. Cortical slices are then found to exhibit a new 
form of activity, producing several avalanches per hour 
of different duration, in which non-synchronous activity 
is spread over space and time. By analysing the size and 
duration of neuronal avalanches, the probability distri- 
bution reveals a power law behaviour, suggesting that 
the cortical network operates in a critical state. The 
experimental data indicate for the avalanche size distri- 
bution a slope varying between -1.2 and -1.9, depending 
on the accuracy of the time-binning procedure, with a 
value -1.5 for optimal experimental conditions. Inter- 
estingly, the power law behaviour is destroyed when the 
excitability of the system is increased, contrary to what 
expected since the incidence of large avalanches should 
decrease the power law exponent. The distribution then 
becomes bimodal, i.e. dominated either by very small or 
very large avalanches as in epileptic tissue. The power 
law behaviour is therefore the indication of an optimal 
excitability in the system spontaneous activity. More- 
over the avalanche time duration is also found to follow 



a power law behaviour as function of the duration time 
normalised by the binning time with an exponent equal 
to -2.0 followed by an exponential cutoff. These results 
have been interpreted relating spontaneous activity in a 
cortical network to a critical branching process [3(, in- 
deed the experimental branching parameter is very close 
to the critical value equal to one, at which avalanches at 
all scales exist. 

On the other hand, the dynamics observed in sponta- 
neous brain activity is very similar to self-organized crit- 
icality (SOC) 0, [ESQ. The term SOC usually refers 
to a mechanism of slow energy accumulation and fast en- 
ergy redistribution driving the system toward a critical 
state, where the distribution of avalanche sizes is a power 
law obtained without fine tuning: no tunable parameter 
is present in the model. The simplicity of the mechanism 
at the basis of SOC has suggested that many physical 
and biological phenomena characterized by power laws 
in the size distribution, represent natural realizations of 
SOC. For instance, SOC has been proposed to model 
earthquakes [1, H, [l(| , the evolution of biological systems 
(Tl| , solar flare occurrence [l2| . fluctuations in confined 
plasma snow avalanches [14| and rain fall [To] ]. 

Moreover, power law behaviour is observed in power 
spectra of different time series monitoring neural activi- 
ties. Prominent examples are EEG data which are used 
by neurologists to discern sleep phases, diagnose epilepsy 
and other seizure disorders as well as brain damage and 
disease [H, [l7| . Another example of a physiological func- 
tion which can be monitored by time series analysis is the 
human gait which is controlled by the brain [181 ]. For all 
these time series the power spectrum, i.e. the square of 
the amplitude of the Fourier transformation double loga- 
rithmically plotted against frequency, generally features 
a power law at least over one or two orders of magnitude 
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with exponents between 1 and 0.7. Moreover, experi- 
mental results show that the neurotransmitter secretion 
rate exhibits fluctuations with time having power law be- 
haviour [1 91 ] and power laws are observed in fluctuations 
of extended excitable systems driven by stochastic fluc- 
tuations [20j . 

On the basis of these observations, recently a model 
based on SOC ideas and taking into account synaptic 
plasticity in a neural network [2l| has been proposed. 
Plasticity is one of the most astonishing properties of the 
brain, occuring mostly during development and learning 
{22L I23L [2^ | . and can be defined as the ability to mod- 
ify the structural and functional properties of synapses, 
properties which are thought to underlie memory and 
learning. Among the postulated mechanisms of synap- 
tic plasticity, the activity dependent Hebbian plastic- 
ity constitutes the most fully developed and influential 
model of how information is stored in neural circuits 
[H [H, Within a SOC approach the four most im- 
portant ingredients for neuronal activity have been intro- 
duced, namely threshold firing, neuron refractory period, 
activity-dependent synaptic plasticity and pruning. 

The system consists in an electrical network on a 
square lattice, on which each site represents the cell body 
of a neuron, each bond a synapse. Therefore, each site 
is characterized by a potential and each bond by a con- 
ductance. Whenever at a given time the value of the 
potential at a site is above a certain threshold, approx- 
imately equal to —55mV for the real brain, the neuron 
fires, i.e. generates an "action potential", distributing 
charges to its connected neighbours in proportion to the 
current flowing through each bond. After firing, a neuron 
goes back to the resting potential of —70mV and remains 
inactive during the refractory period, when it is unable 
to send or receive information from other neurons. This 
time corresponds for real neurons to the physiological 
time needed to reset ion channels after the transmission 
of the action potential through the axon. The conduc- 
tances, on the other hand, represent Hebbian synapses, 
for which the conjunction of activity at the presynap- 
tic and postsynaptic neuron modulates the efficiency of 
the synapse [27j. To this extent, each time a synapse 
transmits an action potential between active neurons, its 
strength is increased proportionally to the intensity of 
the transmitted signal, whereas synapses inactive during 
a neuronal avalanche have their strength decreased, as 
for Hebbian rules. Synapses successively weakened may 
have their strength finally set to zero, i.e. are "pruned", 
eliminating that particular connection between neurons. 
Pruning implies that, as activity goes on, the initial reg- 
ular lattice is transformed, some patterns are strength- 
ened and the connectivity of some neurons decreased. 
The system exhibits an avalanche activity power law dis- 
tributed with an exponent close to -1.5, as measured for 
spontaneous activity [l| . The analysis of the power spec- 
tra of the electrical signal reproduces very robustly the 
power law behaviour with the exponent 0.8, experimen- 
tally measured in EEG spectra. The same value of both 



exponents is found considering leaky neurons or introduc- 
ing a small precentage of inhibitory synapses, indicating 
that universality holds for a wide class of brain models. 

In real brain neurons are known to be able to develop 
an extremely high number of connections with other neu- 
rons, that is a single cell body may receive inputs from 
even a hundred thousand presynaptic neurons. One of 
the most fascinating questions is how an ensemble of 
living neurons self-organizes, developing connections to 
give origin to a highly complex system. The dynam- 
ics underlying this process should be driven both by the 
aim of realizing a well connected network leading to ef- 
ficient information transmission, and the energetic cost 
of extablishing very long connections. The morphologi- 
cal characterization of a neuronal network grown in vitro 
has been studied [28[ by monitoring the development of 
neurites in an ensemble of few hundred neurons from 
the frontal ganglion of adult locusts. After few days 
the cultured neurons have developed an elaborated net- 
work with hundreds of connections, whose morphology 
and topology has been analysed by mapping it onto a 
connected graph. The short path length and the high 
clustering coefficient measured indicate that the network 
belongs to the category of small- world networks [5^] , in- 
terpolating between regular and random networks. How- 
ever, the system grown in vitro necessarily lacks some 
features of in vivo systems, therefore the average node 
connectivity is found equal only to few units and the 
"scale- free" feature 30] of many real networks was not 
recovered. Small-world networks are characterized by an 
efficient information transmission with a small number 
of long range connections. The activity dependent brain 
model [2l[ has been implemented on small world net- 
works, by rewiring a small percentage of the square lat- 
tice bonds. Again universal scaling behaviour is recov- 
ered for both the avalanche distribution and the power 
spectra. The simple rewiring procedure, however, only 
allows long range connections leaving the average node 
connectivity equal to a few units, as for in vitro systems. 

In this paper we investigate the behaviour of the activ- 
ity dependent brain model on scale-free networks, whose 
feature are closer to the morphology of neuronal networks 
in living brains. Scale-free networks are indeed character- 
ized by a power law distribution of the node connectivity, 
allowing a high number of connections per neuron. We 
develop the model on the Apollonian network [3l|, that 
has the property of being simultaneously small-world and 
scale-free and therefore exhibits all characteristics found 
for neuronal networks. Analogously to previous stud- 
ies, we analyse the behaviour of the avalanche size and 
duration distribution and the power spectra related to 
electrical activity. We also study a system composed by 
both excitatory and inhibitory sysnapses, to be closer to 
real brains. The paper is organized as follows: In sectlHl 
the scale-free Apollonian network is described, whereas 
in section HTT1 the activity dependent brain model is pre- 
sented and the results on brain activity are discussed in 
section IIVI Concluding remarks are given in section [VJ 
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FIG. 1: Apollonian network for N = 2: iterations n = 0, 1, 2 
are symbols Qi'i 1 ! respectively. 



II. APOLLONIAN NETWORK 

The Apollonian network has been recently introduced 
[3ll | in a simple deterministic version starting from the 
problem of space-filling packing of spheres according to 
the ancient Greek mathematician Apollonius of Perga. In 
its classical version the network associated to the packing 
gives a triangulation that physically corresponds to the 
force network of the packing. One starts with the zero-th 
order triangle of corners P\ , P2 , P3, places a fourth site 
P4 in the center of the triangle and connects it to the 
three corners {n = 0). This operation will divide the 
original triangle in three smaller ones having in common 
the central site. The iteration n = 1 proceeds placing 
one more site in the center of each small triangle and 
connecting it to the corners (Fig.l). At each iteration n, 
going from to N, then the number of sites increases by 
a factor 3 and the coordination of each already existing 
site by a factor 2. More precisely, at generation N there 
are 



m(k,N) = 3 



JV 



,3 , 3, 1, 3 



vertices with connectivity degree 
k(N) = 3,3 x 2,3 x 2 2 , 



3x2 Ar - 1 ,3x2 N ,2 Ar+1 + l 



respectively where the two last values correspond to the 
site P4 and the three corners Pi , P% , P3 . The maximum 
connectivity value then is the one of the very central site 
Pa, k m ax — 3 x 2 N , whereas the sites inserted at the N-th 
iteration will have lowest connectivity 3. 

The important property of the Apollonian network is 
that it is scale- free. In fact, it has been shown [3l[ 
that the cumulative distribution of connectivity degree 
P(k) = Y.k'>k m i k , N)/N N , where N N = 3 + (3^ N+1 '> - 
l)/2 is the total number of sites at generation N, has 
a power law behaviour with k. More precisely, P(k) oc 
A: 1-7 , with 7 = In 3/ In 2 ~ 1.585. Moreover the network 



has small- world features. This implies [29( that the av- 
erage length of the shortest path I behaves as in random 
networks and grows slower than any positive power of 
N, i.e. I oc (IniV) 3 ' 4 . Furthermore the clustering co- 
efficient C is very high as in regular networks (C = 1) 
and contrary to random networks. For the Apollonian 
network C has been found to be equal to 0.828 in the 
limit of large N. On this basis the Apollonian network 
appears to have all the features typical of neuronal net- 
works: small-world property found experimentally [28[ 
and possibility of very high connectivity degree (scale- 
free). Moreover it also presents bonds connecting sites 
of all lengths. Also this last feature is characteristic of 
neuronal networks in brain cortex, where the length of an 
axon connecting the pre-synaptic with the post-synaptic 
neuron can vary over several orders of magnitude, from 
fira to cm. 



III. ACTIVITY DEPENDENT MODEL 

On a Apollonian network at generation N, we assign 
at each site a neuron at potential Vi and at each bond a 
synapse of conductance gij . Whenever at time t the value 
of the potential at a site i is above a certain threshold 
Vi > w max , the neuron generates an action potential, dis- 
tributing charges to connected neurons in proportion to 
the current flowing through each bond 



i>i(t+l) =«,(*) +«,-(*) 



(i) 



where Vj(t) is the potential at time t of site j, connected 
to site i, iij = gijivi — Vj) and the sum is extended to all 
k sites connected to site i that are at a potential Vk < Vi. 
After firing a neuron is set to a zero resting potential. 

The conductances can be initially all set equal or else 
random between and 1, whereas the neuron poten- 
tials are uniformly distributed random numbers between 
Umax ^ 2 and v max — 1. In agreement with the SOC sce- 
nario, the initial state for the voltage is not relevant since 
the system evolves toward the same critical state regard- 
less of the initial condition. The potential is fixed to zero 
at the three sites 1,2,3 where information can flow out 
of the system. The external stimulus can be imposed at 
one input site chosen either fixed or at random, this last 
case modelling more closely spontaneous brain electrical 
activity. 

The firing rate of real neurons is limited by the re- 
fractory period, i.e. the brief period after the generation 
of an action potential during which a second action po- 
tential is difficult or impossible to elicit. The practical 
implication of refractory periods is that the action poten- 
tial does not propagate back toward the initiation point 
and therefore is not allowed to reverberate between the 
cell body and the synapse. In the model, once a neu- 
ron fires, it remains quiescent for one time step and is 
therefore unable to accept charge from firing connected 
neurons. This ingredient indeed turns out to be crucial 
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for a controlled functioning of the numerical model. In 
this way an avalanche of charges can propagate far from 
the input through the system. 

As soon as a site is at or above threshold w m ax at a 
given time t, it fires according to Eq. (1). Then the 
conductance of all the bonds, connecting to active neu- 
rons and that have carried a current, is increased in the 
following way 



9ij(t+l) = gij(t) + Sgij(t) 



(2) 



where Sgij (t) = Aaiij (t) , with a being a dimensionlcss 
parameter and A a unit constant bearing the dimen- 
sion of an inverse potential. After applying Eq. (2) the 
time variable of the simulation is increased by one unit. 
Eq. (2) describes the mechanism of increase of synap- 
tic strength, tuned by the parameter a. This parameter 
then represents the ensemble of all possible physiological 
factors influencing synaptic plasticity, many of which are 
not yet fully understood. 

Once an avalanche of firings comes to an end, the con- 
ductance of all the bonds with non-zero conductance is 
reduced by the average conductance increase per bond, 
Ag = J2ij,t $9ij{t)/Nb, where Nb is the number of bonds 
with non-zero conductance. The quantity Ag depends on 
a and on the response of the brain to a given stimulus. In 
this way the network "memorizes" the most used paths 
of discharge by increasing their conductance, whereas the 
less used synapses atrophy. Once the conductance of a 
bond is below an assigned small value a t , it is removed, 
i.e. is set equal to zero, which corresponds to what is 
known as pruning. This remodelling of synapses mimicks 
the fine tuning of wiring that occurs during " critical peri- 
ods" in the developing brain, when neuronal activity can 
modify the synaptic circuitr y, o nce the basic patterns of 
brain wiring are established [231 ] . These mechanisms cor- 
respond to a Hebbian form of activity dependent plastic- 
ity, where the conjunction of activity at the presynaptic 
and postsynaptic neuron modulates the efficiency of the 
synapse [271 ]. To insure the stable functioning of neural 
circuits, both strengthening and weakening rules of Heb- 
bian synapses are necessary to avoid instabilities due to 
positive feedback [33]. However, differently from the well 
known Long Term Potentiation (LTP) and Long Term 
Depression (LTD) mechanisms, the modulation of synap- 
tic strength does not depend on the frequency of synapse 
activation [22l . l33l . l3~ij . The external driving mechanism 
to the system is imposed by setting the potential of the 
input site to the value v max , corresponding to one stimu- 
lus. This external stimulus is needed to keep the system 
functioning and therefore mimicks the living brain activ- 
ity. The discharge evolves until no further firing occurs, 
then the next stimulus is applied. 



IV. NUMERICAL RESULTS 

We consider an Apollonian net at the generation N = 9 
(29527 neurons and 177150 synapses). The three corner 
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FIG. 2: Average number of pruned bonds as function of time 
for three different values of a and equal initial conductances. 
In the inset, asymptotic number of active bonds as function 
of q. The maximum is for a — 0.020 where are active about 
80% of bonds. 



sites of the system have always zero potential and rep- 
resent open boundary conditions. The input site is ei- 
ther chosen at random or fixed. It is worth noticing that 
the case of random input sites simulates more closely 
the spontaneous activity of the system. Synapses can 
be excitatory or inhibitory with probability p m h- Ini- 
tial conductances can be either all equal to go = 0.25 or 
randomly distributed between and 1. The other pa- 
rameters in the simulation are: firing threshold w m ax = 6 
and conductance cut-off for pruning at = 0.0001. Their 
value does not influence the simulation results. 

Pruning 

The strength of the parameter a, controlling both the 
increase and decrease of synaptic strength, determines 
the plasticity dynamics in the network. In fact, the more 
the system learns strengthening the used synapses, the 
more the unused connections will weaken. We apply a 
sequence of external stimuli and we measure the total 
number of pruned bonds at the end of each avalanche, 
N p b- This quantity in general could depend on the ini- 
tial conductance go, therefore the two cases of all initial 
conductances equal to 0.25, and uniformly distributed 
between and 1, are investigated. 

First the case of equal initial conductances is anal- 
ysed. For each value of a the average number of pruned 
bonds, Npb, is monitored as function of time, where a 
time unit corresponds to the application of an external 
stimulus. For input sites randomly chosen at each stimu- 
lus, Fig. 2 shows that pruning starts after a certain time, 
since all conductances are initially equal to 0.25, and 
Npb increases more rapidly with time for larger a. The 
plateau is reached after about 5000 stimuli (for every a) 
after which N p b increases only of few units in time. From 
the asymptotic value of each curve we can evaluate the 
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time 

FIG. 3: (Color online) Probability of pruning for bonds of dif- 
ferent iterations n as function of time for equal initial conduc- 
tances. In the inset, the asymptotic N p t (after 5000 stimuli) 
as function of n with the exponential fit N p b — exp 1.2n. 




FIG. 4: (Color online) Connectivity degree distribution n(k) 
at different pruning stages t for equal initial conductances and 
a = 0.020. In the inset the corresponding behaviour of the 
number of pruned bonds. 



asymptotic number of active bonds as function of a and 
determine that the value of a maximizing the number of 
active bonds is about 0.020. This could be interpreted as 
an optimal value for the system with respect to plastic 
adaptation: it maximizes the number of active connec- 
tions under the competing strengthening and weakening 
rules. 

In order to understand if pruning acts in the same way 
on bonds created at different iterations n, n = 0, . . . , N, 
or rather tends to eliminate some particular iteration, 
the probability to prune bonds of different n is evalu- 
ated, that is the number of pruned bonds over the total 
number of bonds for each iteration stage, as function of 
time. Fig. 3 shows that the plateau is reached at about 
the same time and the shape of the curve is similar for 
each n. However the probability to prune bonds with 
large n is higher: These are the bonds created in the last 
iterations and therefore embedded in the interior of the 
network. This suggests that the most active bonds are 
the long range ones (small n), that therefore optimize in- 
formation transport through the network. In the inset of 
Fig. 3 we show the asymptotic number of pruned bonds 
per generation on a semi-log scale, this quantity is well 
fitted by the exponential behaviour N p b — exp n. 

The same analysis has been performed for random ini- 
tial conductances between and 1. The results are sim- 
ilar to the previous case. It can be noticed that pruning 
starts already at t = 1, since conductances close to zero 
are present, and the plateau is reached after about 3000 
stimuli. The value of a which now optimizes the number 
of active bonds is about 0.030. Finally the pruning be- 
haviour for different iterations is similar to the previous 
case, with the pruning probability also increasing with n 
exponentially as N p b — exp n. 

The effect of pruning on the connectivity degree of the 



network (Fig. 4) has also been analysed, i.e. the number 
of sites with a given connectivity degree k as function of 
k in the initial network and after application of a given 
number of external stimuli. In order to identify the dif- 
ferent stages in the pruning process, the inset of Fig. 4 
shows the total number of pruned bonds as function of 
time. After the application of few external stimuli, i.e. 
for a short plastic training, the distribution n(k) shows 
the same scaling behaviour of the Apollonian network. 
As the pruning process goes on, sites vary their connec- 
tivity and new values of k appear. The result is that 
the scaling behaviour is progressively lost, as well as the 
scale-free character of the network, since there is a gen- 
eralized decrease of connectivity in the network. In the 
analysis of spontaneous activity it is therefore important 
to impose a not too extended plastic training in order to 
avoid an excessive decrease of connectivity degree of the 
network. 

Spontaneous activity: avalanche distributions 

After training the system applying plasticity rules dur- 
ing N p external stimuli, we now submit the system to a 
new sequence of stimuli with no modification of synap- 
sis strength. The response of the system to this second 
sequence models the brain spontaneous activity, which 
is analysed by measuring the avalanche size distribution 
n(s), the time duration distribution n(T), and the power 
spectrum S(f). 

The avalanche size distribution n(s) consistently ex- 
hibits power law behaviour for different values of model 
parameters. Fig. 5 shows the avalanche size distribution 
for different values of N p , including also the case N p = 
(no plasticity training) for random initial conductances. 
We notice that, for fixed size s, increasing N p decreases 
the number of avalanches of that size, suggesting that 
strong plasticity remodelling decreases activity. The ex- 
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FIG. 5: (Color online) Avalanche size distribution for different 
values of N p , random initial conductances, a = 0.030 and 
random input site. In the inset the corresponding behaviour 
of the number of pruned bonds. 



FIG. 6: (Color online) Avalanche size distribution for input 
sites randomly chosen among sites with the same connectivity 
degree k. Only distributions for small k are shown, for higher 
k the scaling behaviour is lost (random initial conductances, 
a = 0.030, AT,, = 100). 



ponent appears to be independent of N p as long as the 
number of pruned bonds, N p b, is far from the plateau (see 
inset in Fig. 5). Similar results are found for equal initial 
conductances, The value of the exponent is a = 1.8 ±0.2 
and is stable with respect to variations of the parameter 
a for both equal and random initial conductance. This 
value is compatible within error bars with the value found 
in the experiments of Beggs and Plentz 1.5 ± 0.4, 
and with previous results of the model on both regular 
and small world lattices. This suggests that the high 
level of connectivity reduces the probability of very large 
avalanches but does not change substantially the sponta- 
neous activity behaviour. For larger N p , the distribution 
exhibits an increase in the scaling exponent and finally 
looses the scaling behaviour for very large N p values in 
the plateau regime for the number of pruned bonds. 

It is important to investigate the role of the choice of 
fixed input site, since in the Apollonian network, con- 
trary to the regular network, sites may have very dif- 
ferent connectivity degree. Fig. 6 shows the avalanche 
size distribution for input sites randomly chosen among 
sites with given connectivity degree k. In this way it is 
possible to detect solely the effect due to the connectiv- 
ity of the input site, eliminating all other effects due to 
the particular position of the input site in the network. 
Power law behaviour is found for connectivity degree of 
the input site up to k = 12. The scaling exponent de- 
creases with increasing connectivity degree k of the input 
site, that is for larger k larger avalanches become more 
probable. However, if the connectivity degree increases 
further, the scaling behaviour is lost. This is due to the 
fact that an input site with very high connectivity must 
distribute its charge to many connected sites and there- 



fore the network activity will be damped already at the 
initial site. Therefore, to reproduce the experimentally 
observed scaling behaviour, the fixed input site should 
be chosen with low connectivity degree (k < 12). The 
avalanche size distribution for fixed input site with con- 
nectivity k = 3 or k = 6 exhibits power law behaviour 
with the same exponents found for random input site: 
(7 = 1.8 ±0.2 for equal and random initial conductances. 

At time t — a neuron is activated by an external 
stimulus initiating the avalanche. This will continue un- 
til no neuron is at or above threshold. The number of 
avalanches lasting a time T, n(T), as function of T ex- 
hibits power law behaviour (Fig. 7) with an exponential 
cutoff. The scaling exponent is found to be r = 2.1 ± 0.2 
for equal and random initial conductances. This value 
is found to be stable with respect to different a (Fig. 7) 
and N p , provided that the number of pruned bonds N p b 
is lower than the plateau for that value of a. Moreover 
it does not depend on the choice of the input site, either 
fixed or random. Finally both values agree within error 
bars with the value 2.0, exponent found experimentally 
by Beggs and Plentz |l|. 

Power spectra for spontaneous activity 

In order to compare the results of the Apollonian net- 
work with EEG medical data, the power spectrum of the 
resulting time series can be calculated. For this purpose, 
the number of active neurons is monitored as function of 
time during spontaneous activity. Fig. 8 shows an exam- 
ple of neuronal activity where avalanches of all sizes can 
be generated in response to the external stimulus. The 
power spectrum is calculated as the squared amplitude of 
the Fourier transform as function of frequency, averaged 
over many sequences of external stimuli. 

Fig. 9 shows the spectrum for equal initial conductances 




FIG. 7: (Color online) Avalanche duration distribution for 
different values of a (random initial conductances, random 
input sites, N p = 500). The dotted line has slope 2.1. 



FIG. 9: (Color online) Power spectra for different N p , equal 
initial conductances, a — 0.020 and random input sites. 




FIG. 8: Total current flowing in the system as function of 
time. Avalanches of all sizes can be observed. 



and different values of N p . For N p = 0, i.e. when no 
plasticity mechanism is applied, the spectrum has a be- 
haviour 1//, characteristic of SOC. For values of N p dif- 
ferent from zero but before N p b reaches the plateau, one 
can distinguish two different regimes: a power law be- 
haviour with exponent (3 = 0.8 ± 0.1 at high frequency, 
followed by a crossover toward white noise at low fre- 
quency. However, for N p = 2000 (close to the plateau 
value for N p b) the scaling behaviour with exponent 0.8 
is detected over a wider frequency range. The difference 
between (3 — 1 for N p = and (3 ~ 0.8 for higher N p , 
suggests that the existence of plasticity rules reduces the 
power spectrum exponent reaching agreement with ex- 
perimental EEG spectrum [36|, [3?| • The stability of the 
exponent with respect to a has also been verified, find- 
ing consistently (3 = 0.8 ±0.1 at high frequency. Finally 



the power spectrum for fixed input site shows a scaling 
exponent (3 — 0.8 ± 0.1 over two orders of magnitude. 
The measured value for the power spectra exponent is in 
agreement with the expected relation with the scaling ex- 
ponent of the avalanche duration distribution (3 = 3 — r, 
being — r < — 1 @. 

The scaling behaviour of the power spectrum can be 
interpreted in terms of a stochastic process determined 
by multiple random inputs [Hj]. In fact, the output sig- 
nal resulting from different and uncorrelated superim- 
posed processes is characterized by a power spectrum 
with power law behaviour and a crossover to white noise 
at low frequencies. The crossover frequency is related to 
the inverse of the longest characteristic time among the 
superimposed processes. The value of the scaling expo- 
nent depends on the ratio of the relative effect of a process 
of given frequency on the output with respect to other 
processes. 1// noise corresponds to a superposition of 
processes of different frequency having all the same rela- 
tive effect on the output signal. In our case the scaling 
exponent is smaller than unity, suggesting that processes 
with high characteristic frequency are more relevant than 
processes with low frequency in the superposition (38j. 

Inhibitory synapses 

In the mature living brain synapses can be excitatory 
or inhibitory, namely they set the potential of the post- 
synaptic membrane to a level closer or farther, respec- 
tively, to the firing threshold. This ingredient can be 
indroduced by considering each synapse inhibitory with 
probability pi n and excitatory with probability 1 — pi n . 
The avalanche size and duration distributions show that 
the exponents a and r increase for increasing pi n , there- 
fore for a high percentage of inhibitory synapses the prob- 
ability of large avalanches decreases (Fig. 10). On the reg- 
ular lattice for pi n — 0.5 no longer power law but expo- 
nential behaviour is found [2l| . In the present case scal- 
ing behaviour persists due to the very high connectivity 
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FIG. 10: (Color online) Avalanche size distributions for differ- 
ent pin, equal initial conductances, a — 0.020, random input 
sites and N p = 1700. 

degree, suggesting that the Apollonian network is better 
suited to model the neural connections in the brain. 

The power spectra for different values of pi n exhibit a 
complex behaviour. In fact, for a small fraction of in- 
hibitory synapses (pi„ < 0.05) the power law exponent (3 
increases with respect to the case where synapses are all 
excitatory up to a value 1.2. Then, for p.;„ ~ 0.10, the 
exponent decreases toward values compatible with exper- 
imental results, i.e. between 0.7 and 1.0. By increasing 
further the percentage of inhibitory synapses, to values 
close or greater than 0.2, the spectrum becomes the one 
of white noise. 



V. CONCLUSIONS 

Extensive simulations have been performed for the ac- 
tivity dependent brain model implemented on the scale- 



free Apollonian network. The results are compared with 
previous simulations on regular and small world lat- 
tices and with experimental data. We first find the 
striking result that an optimal value of of the plastic- 
ity strength a exists with respect to the pruning pro- 
cess. Moreover, it appears that synapses of later gen- 
erations, deeply embedded in the network, are pruned 
with higher probability with respect to bonds of the 
early generations, mostly long range, that optimize in- 
formation transmission. Moreover the avalanche size dis- 
tribution shows a power law behaviour with an expo- 
nent a = 1.8 ± 0.2 for equal and random initial conduc- 
tances. This value is compatible with 1.5 ± 0.4, exper- 
imentally found for neuronal avalanches and recovered 
by the model on the square lattice and small world net- 
works. Also the avalanche duration distribution exhibits 
power law behaviour with an exponential cutoff, in agree- 
ment with experimental results of Beggs and Plentz [l[ . 
The exponent has value: t = 2.1 ± 0.2 for equal and ran- 
dom initial conductance, in agreement with 2.0 found ex- 
perimentally Furthermore the power spectrum exhibits 
power law behaviour at high frequency with 8 = 0.8±0.1, 
in agreement with experimental data [36l |3?| . At inter- 
mediate frequency the slope becomes greater than unity, 
crossing over to white noise at low frequencies. None of 
the scaling exponents for spontaneous activity in the case 
of excitatory synapses depends on the particular choice 
for the length or strength of the plasticity training and 
are quite stable with respect to the initial conductance 
configurations. These results suggest that also on Apol- 
lonian network universal behaviour found for regular and 
small world networks [2l[ holds. Furthermore, the scale- 
free Apollonian net provides an excellent description both 
of the morphology and the electrical activity properties 
of the brain. 
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